HAR-Depth: A Novel Framework for Human Action Recognition Using Sequential Learning and Depth Estimated History Images
نویسندگان
چکیده
Human action recognition (HAR) is a challenging task due to the presence of pose and temporal variations in videos. To address these challenges, HAR-Depth proposed this paper with sequential shape learning along novel concept depth history image (DHI). A deep bidirectional long short term memory (DBiLSTM) constructed for model relationship existing between frames. Action information each frame extracted using pre-trained convolutional neural network (CNN). The estimated projected onto X-Y plane form DHI. During learning, through DHI used train CNN network. By leveraging trained knowledge network, overfitting issue handled. finetuned recognize actions from query images. Data augmentation adopted avoid by virtually increasing training set. work evaluated on publicly available datasets like KTH, UCF sports, JHMDB, UCF101, HMDB51 achieves performance accuracy 97.67%, 95.00%, 73.13%, 92.97%, 69.74% respectively. results suggest that performs better terms overall accuracy, kappa parameter precision compared other state-of-the-art algorithms present earlier reported literature.
منابع مشابه
Human Action Recognition based on MSVM and Depth Images
Human behavior Analysis, using visual information in a given image or sequence of images, has been an active area of research in computer vision community. The image captured by conventional camera does not provide the suitable information to perform comprehensive analysis. However, depth sensors have recently made a new type of data available. Most of the existing work focuses on body part det...
متن کاملSequential Deep Learning for Human Action Recognition
We propose in this paper a fully automated deep model, which learns to classify human actions without using any prior knowledge. The first step of our scheme, based on the extension of Convolutional Neural Networks to 3D, automatically learns spatio-temporal features. A Recurrent Neural Network is then trained to classify each sequence considering the temporal evolution of the learned features ...
متن کاملEffective Improvement for Depth Estimated Based on Defocus Images
This paper introduces a new concept called controllable ring signature which is ring signature with additional properties as follow. (1) Anonymous identification: by an anonymous identification protocol, the real signer can anonymously prove his authorship of the ring signature to the verifier. And this proof is non-transferable. (2) Linkable signature: the real signer can generate an anonymous...
متن کاملA Generic Regression Framework for Pose Recognition on Color and Depth Images
Wenye He Cascaded regression method is a fast and accurate method on finding 2D pose of objects in RGB images. It is able to find the accurate pose of objects in an image by a great number of corrections on the good initial guess of the pose of objects. This paper explains the algorithm and shows the result of two experiments carried by the researchers. The presented new method to quickly and a...
متن کاملAction recognition system based on human body tracking with depth images
When tracking a human body, action recognition tasks can be performed to determine what kind of movement the person is performing. Although a lot of implementations have emerged, state-of-the-art technology such as depth cameras and intelligent systems can be used to build a robust system. This paper describes the process of building a system of this type, from the construction of the dataset t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE transactions on emerging topics in computational intelligence
سال: 2021
ISSN: ['2471-285X']
DOI: https://doi.org/10.1109/tetci.2020.3014367